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1. Introduction 

Let k be an algebraically closed field of characteristic p. Let Mg^p be the coarse 
moduli space of principally polarized Abelian varieties of dimension g > 2 de- 
fined over k. It is an interesting question in characteristic p geometry to describe 
the various stratum in Mg^p defined by the Newton polygon. By a theorem of 
Grothendieck, the sublocus Ng^p in Mg^p which underhes the isomorphism classes 
of the Abelian varieties with positive Newton slopes is naturally an closed alge- 
braic subvariety. 

In this paper we study the intersection behavior of an algebraic curve C° of 
Mg^p with Ng^p, which is induced by a family of algebraic curves of genus g over 
k with nontrivial Kodaira-Spencer map and does not lie entirely in Ng^p. More 
concretely we let / : X — C be a semi-stable family of algebraic curves which 
compactifies the smooth family /° : — > C°. Namely, one has the following 
commutative diagram: 



XO 


X 









f 


(JO 


C. 



In this paper we shall call the sublocus of C supporting the closed fibers whose 
Newton slopes are all positive special. It is also the locus where the p-rank of the 
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Jacobians of the algebraic curves are equal to zero. For such a complete family 
as in the above diagram we will give an upper bound of the cardinality of the 
special locus by a function of the genus b of the compactification C of the 
degree s of the divisor C — C°, the genus g and the prime number p. 

2. Frobenius Morphism on the Second Hodge Bundle 

Let A be an ^f- dimensional Abelian variety defined over Fg with elements. 
Let {F, H^j.ig{A)) be the F-crystal associated with A. For a F-crystal one has 
the notion of Hodge polygon and Newton polygon (see [3] for the definitions). 
While the Hodge polygon of (F, if^^j^(A)) remains the same for all [A] G Mg^p, 
the Newton polygon of it does depend on the algebraic structure of A, which 
is actually equal to the Newton polygon of the characteristic polynomial on 
H^^^g{A). One knows that in general the Newton polygon lies on or above the 
Hodge polygon and both have the same end points. The two extreme cases are 
that A is ordinary when the Newton polygon and the Hodge polygon coincides, 
and A is supersingular when the Newton slopes are all equal. 

Let Fa '■ A ^ Ahe the absolute Frobenius morphism defined by raising power 
p on the structure sheaf of rings of A. It induces in turn the morphism 

FX:H\A,Oa)^H\A,Oa). 

It is known that A is ordinary if and only if F\ is an isomorphism. On the other 
hand, we have the following simple 

Lemma 2.1. Let A he an g -dimensional Abelian variety defined over k. The 
Newton slopes of A are all positive if and only if the morphism 

{FXy:H\A, Oa)^H\A, Oa) 

is zero map. 

Proof: Let {F,Hl^^^{A,W{k))) be the F-crystal of A. It is known that the 
/c-vector space H^{A, Oa) is a natural quotient of Hl^^^i^A, W{k)) modulo p, and 
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the map F modulo p induces a natural morphism on H^{A^ C>a), which is iden- 
tical to FX- By Katz 1.3.3 [3j, all Newton slopes are positive if and only if 
W{k))) C pHl^i^{A, W{k)), which implies in particular 

{FXf3:H\A, Oa)^H\A, Oa) 

is zero map. But since dim/c H^{A., Oa) = g, the g times iterate {FX)^ is already 
zero. Conversely, if (F^)^ is a zero morphism, then 

is zero. Since 2g > g + implies that 

F^^{Hl,XA, W{k))) C pHl^XA, W{k)). 

Then still by Katz's remark, the Newton slopes of Hl^^^{A., W{k)) are all positive. 

□ 



Now we begin to consider the family situation. Let f : X ^ C over k be 
a semi-stable family of ^f- dimensional Abelian varities over a smooth projective 
base curve with nontrivial Kodaira-Spencer map. Let S be the singular locus and 
A = f^^{S) the simple normal crossing divisor of X consisting of all semi-stable 
singular fibers of /. We introduce as usual the Hodge bundles of /: 

E'^' = /,r]^/c(log A), = R'f.Ox. 

In characteristic p, we have the following commutative diagram induced by the 
absolute Frobenius morphisms of the base C and the total space X: 

Prel Pr 

X X — - X 




f 



f 



c 



Fc 



c 



where /' : X' — C is the base change of / under Fc and Frei : X ^ X' is the 
relative Frobenius morphism. 
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Lemma 2.2. The relative Frohenius morphism F^ei induces a natural morphism 
of Oc -modules 

Proof: The relative Frobenius morphism F^ei gives the O;^' -morphism of sheaves 

Ox' FreuOx- 
It induces the morphism on the direct images 

R'flOx' ^ R'fliFr^uOx)- 
The target sheaf has the natural morphism by spectral sequence 

R'fliFreuOx) - R\f' O Frel).Ox. 

Composition of the above two morphism yields the morphism 

R'flOx' - R'f.Ox- 

Finally, by the flat base change theorem(cf. Proposition 9.3 [2j) the source sheaf 
R^flOx' is isomorphic to F^R^ f^Ox- The claim then follows. 

□ 



3. An Arakelov-Yau Bound of Hodge Bundles for a Semi-stable 

Family of Algebraic Curves 

Let / : X ^ C be a semi-stable family of algebraic curves of genus g > 2 
with nontrivial Kodaira-Spencer map, where C is a smooth projective algebraic 
curves over k. The non-triviality of Kodaira-Spencer map is equivalent to saying 
that the family / is non-isotrivial and it is not the base change of another family 
/' : X' — > C under Frobenius map Fq- Let 5* be the singular locus. We have 
the following Arakelov-Yau bound of the slope of a coherent subsheaf in Hodge 
bundles: 
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Proposition 3.1. Let f : X ^ C be a semi- stable family of algebraic curves over 
k with nontrivial Kodaira- Spencer map. For a coherent sub sheaf £ of f^.u^'j^, v > 
1 we have the upper bound of the slope of S: 

H{S) < 2ug{2b~2 + s) 

where g is the genus of a general fiber, b is the genus of the base curve C and 
s = \S\ the number of the singular fibers. For a coherent sub sheaf T of R^f^Ox 
we have the upper bound of the slope of T : 

/i(^)< 2(7(^7- l)(26-2 + s). 
Proof: We start with the Harder-Narasimhan filtration of f^^uJ^i^: 

It suffices to show the first inequality for £i. 

One notes first that the image sheaf of the natural sheaf morphism a : f*Si —>■ 
w'^lc can be expressed by Xzi^uKx/c — D), where Xz is the ideal sheaf of a zero- 
dimensional subscheme Z, Kx/c a relative canonical divisor and D is an effective 
divisor. Now let H be an ample divisor of X. Since oJx/c is big and nef by Szpiro 
(see Theorem 1 and Proposition 3 in [6j), mvKx/c + -f^ is ample for m > by 
Nakai's criterion (See Theorem 1 in [1]). By Bertini's theorem, one can find a 
smooth curve 

r e \n{mvKx/c + H)\ 

for n large enough such that F intersects transversally with a fixed smooth closed 
fiber F of /, and F is not contained in the support the kernel of a. We put 
TT = /|r. By construction, vr is a separable finite morphism and the restriction of 
a to F 

a|r : it*£i ^ Or{yKx/c - D) 

is non-trivial. Because £i is semi-stable and vr is separable, tt*£i is still semi- 
stable. Hence we have 



/i(7r*(^i)) < degOr{vKx/c - D) = {uKx/c - D)V. 
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We put N = vKx/c -D - fi{Si)F. Then 

NT = {uKx/c - D)r - fi{Si)Fr 
= {uKx/c-D)^-fI{7r*{S^)) 
> 0. 

It implies that N{muKx/c + H) > 0. Since m can be arbitrarily large, we must 
have NKx/c > 0. Therefore, we see that 

uKj,/c = {N + D + fi{S,)F)Kx/c 
> fi{Si)FKx/c 
= {2g-2)fi{S,). 

Now we recall the Szpiro's inequality (see Proposition 4.2 in p]) 

i<'i/c<(4(?-4)(7(26-2 + s). 

By combining the above two inequalities, we obtain the first inequality 

fi{Si) < 2gu{2b-2 + s). 

Now we let z/ = 1 and note that for a semi-stable family f*ujx/c is simply the 
first Hodge bundle as introduced in the last section. By the relative Serre 
duality one has the isomorphism 

So for a given coherent subsheaf of R^f^^Ox = E^'^ of rank r, the dual of the 
quotient sheaf E^'^ jT is a coherent subsheaf of Furthermore, because the 

family / is non-isotrivial, degi?^'^ > 0(cf. Proposition 3 ^Gj). It follows that 

deg(J'^) = -degEi'° + deg(E°'Vj^)* 

< deg(E°'Vj^)* 

< 2(7((7-r)(26-2 + s). 
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Therefore 

Ai(^) < 2g{^—^){2h -2 + s)< 2g{g - 1)(26 - 2 + s). 

r 

The proof is completed. 

□ 

Remark 3.2. In the above proposition we have a better upper bound of the 
sfopes of coherent subsheaves in R^f^:Ox in the case that / contains an ordinary 
closed fiber. Namely, for JF c f\Ox any coherent subsheaf, it holds 

< 0. 

This is because otherwise the image of F^T under F*^i with positive and 

maximal has larger slope than /u(jF). 

Thanks to the main theorem of X. Sun in [5], we are also able to obtain an 
upper bound of the slope of a coherent subsheaf in (F^)"-^*'^"* for i = 0, 1, n>l. 
To our purpose we shall state only the statement for that of E^'^. 

Proposition 3.3. Let f : X C be a semi-stable family of algebraic curves 
over k with nontrivial Kodaira- Spencer map. Let J-" be a coherent subsheaf of 
[F^YR^ f^Ox for n>l. Then the following inequality holds 

< 2g{g - 1)(26 - 2 + + 2(^7 - l){h - 1). 

Proof: For brevity we denote the n-th iterates (-F^)" Frobenius morphism 

F^ by F*. Let JF be a coherent subsheaf of F*E^'^. We claim that 

< ((7-l)(26-2)+p>„„,(E°'i). 

where /imax(-E'°'^) is the maximal slope of the coherent subsheaves contained in 
£■0,1 _ consider the Harder-Narasimhan filtration of E'^'^: 
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One has a natural map a : T F*£rn/ F*£m-i which is the composition of the 
morphisms 

The kernel of a is denoted by /C. 

Theorem 3.1 of X. Sun in [5] says that 

fJ'max{F*{£m/£m-l)) — fl'min{F*{£m/£m-l)) ^ {Q — 1)(26 — 2). 

Since one has 

/^(•^ /^) — f^max(^F^£jYi/ F^£jYi—ij fijYiax(^F^(^£^/ £^—ij^ 

and 

{F*{£m/£m-l)) < fi{F*{£,n/£m-l)) = p'^ n{£m/ £m-l) , 

we get 

/^(^//C) <{g- 1)(26 - 2) +p>(^„/^„_i) <{g- l){2h - 2) + p>^„,(EO'i). 

One notes that /C is a coherent subsheaf of F*£fn-i, and in case that /C is not 
zero sheaf one can study further the projection of JC into the quotient sheaf 
F*£m-i/ F*£m-2- Because for all 1 < i < m one has the inequahty 

we can assume that 

/i(/C) <{g- l){2b - 2) + 

by an inductive argument. Actually, one has 

deg(J^^) = degJ^//C + deg/C 

< (((7- l)(26-2) +p>„,,(E°'i))(rank(^//C) +rank(/C)) 
= {{g - 1)(26 - 2) +p>^,,(E°'i))rank(^), 

hence it follows that fi{J-') satisfies the claimed inequality. Now we combine the 
inequality in Proposition 13.11 and thus obtain the inequality in the proposition. 
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□ 



4. Main Result and The Proof 

Let f : X ^ C a. semi-stable family of algebraic curves of genus g > 1 with 
nontrivial Kodaira-Spencer map, where C is a smooth projective algebraic curves 
over k. Let Xt be a smooth closed fiber of /. It is known that the F-crystal 
Hl^^g{Xt) is canonically isomorphic to the F-crystal Hl^^g[Jac{Xt)) of its Jaco- 
bian. We assume that for a general t E C{k) the first Newton slope of Xt is not 
positive. In this section we shall give an upper bound of the cardinality of the 
special locus in C{k). 

We proceed by considering first a relatively simple situation. Namely, we as- 
sume first that there exists an ordinary closed fiber in /. In this case our result 
is to provide an upper bound of the cardinality of Hasse locus of the family /. 
Since the special locus is clearly contained in the Hasse locus, the result gives 
also an upper bound for that of special locus. Precisely, we have the following 

Theorem 4.1. Let f : X ^ C be a semi-stable family of algebraic curves of 
genus g > 1 over smooth projective algebraic curves C of genus b defined over k. 

We assume that the Kodaira-Spencer map of f is non-trivial. Let s he the number 
of singular fibers of f . If there is an ordinary closed fiber in f , then we have the 
following inequality for the degree of the Hasse locus of f : 

degH{f)<2g\p-l){2b-2 + s). 

where H{f) is the Hasse locus of f . 

Proof: We note first that in the g = 1 case the assumption about the existence 
of an ordinary fiber is void, because it is classically known that there exists only 
fintely many supersingular points in the j-line of elliptic curves over k. 
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By taking the wedge g power of F*^i, we obtain a non-trivial morphism of 
invertible sheaves over C: 

9 9 

Hence it must be injective and we have an short exact sequence of coherent 
sheaves over C: 

where Q is a torsion sheaf. Obviously, deg H{f) < degQ. 

On the other hand, we have the Arakelov-Yau bound in Proposition 13.11 for 
g > 2 fibration: 

deg(E^'°) < 2/(26- 2 + 

The above inequality holds also for elliptic fibration. Actually, the Kodaira- 
Spencer map induces a non-trivial morphism 

Then there is an embedding 

{E^'X^ ^ 

This implies that 

degE^'^ < ^(26-2 + s). 

Therefore it follows that 

deg H{f) < deg(g) 

= deg(£;°'^) - deg(F^(E°'i)) 

= (p-l)deg(Ei'°) 

< 2(p- l)/(26-2 + s). 
When g = 1, the bound can be replaced by ^^(26 — 2 + s). 

□ 
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When the family / does not contain an ordinary fiber, the morphism F*^^ : 
F^E^'^ —>■ E^'^ is not an isomorphism at the generic point. So the above proof 
will not apply in a general situation. However, we still have an upper bound of 
the cardinality of the special locus of /, which is the main result of this paper. 

Theorem 4.2. Let f : X ^ C he a semi- stable family of algebraic curves of 
genus g > 2 over smooth projective algebraic curves C over k. We assume that 
the Kodaira- Spencer map of f is non-trivial. The notations is as those in Theorem 
If the Newton slopes of a general closed fiber of f are not all positive, then 
the cardinality of the special locus of f is bounded above by the function 

P{p, g, b, s) = p^[2g{g' - g + l){2b -2 + s)] + 2{g - l){?,g - - 1) + 2g{g - l)s. 
Proof: We consider the composition of the following morphisms: 

and we denote it by $ : {F^)^E^'^ —>■ E^'^. By Lemma [2.11 the morphism $ is 
not zero map under the assumption about /. Thus we obtain the factorization 
of $ 

such that (p is an isomorphism at the generic point. 

Then we have a short exact sequence of coherent sheaves over C 

det ^ det ^ ^ Q ^ 

where Q is a torsion sheaf. Again applying Lemma 12.11 we know that the special 
locus of / is contained in the support of Q. Now the estimation of degQ goes as 
in the proof of Theorem 14. It 

deg Q = deg £ — deg JF 

= deg^: - deg{{F*yE^'^) + deg(ker $) 

= deg £" + deg(ker $) + p^ deg(E^'°) 

< p'[2g{g^ _ ^ + i)(26 - 2 + s)] + 2{g - l){3g - l){b - 1) + 2g{g - l)s. 
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The theorem is therefore proved. 

□ 
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